DECREASING SUBSEQUENCES IN PERMUTATIONS AND 
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Abstract. In a recent paper, Backelin, West and Xin describe a map <p* that 
recursively replaces all occurrences of the pattern k ■ ■ ■ 21 in a permutation 
a by occurrences of the pattern (k — l)---21fc. The resulting permutation 
</>*(ct) contains no decreasing subsequence of length k. We prove that, rather 
unexpectedly, the map <f>* commutes with taking the inverse of a permutation. 

In the BWX paper, the definition of <j>* is actually extended to full rook 
placements on a Ferrers board (the permutations correspond to square boards), 
and the construction of the map <j>* is the key step in proving the following 
result. Let T be a set of patterns starting with the prefix 12 ■ ■ ■ k. Let T" be 
the set of patterns obtained by replacing this prefix by k ■ ■ ■ 21 in every pattern 
of T. Then for all n, the number of permutations of the symmetric group S n 
that avoid T equals the number of permutations of S n that avoid T". 

Our commutation result, generalized to Ferrers boards, implies that the 
number of involutions of S n that avoid T is equal to the number of involutions 
of S n avoiding T", as recently conjectured by Jaggard. 



1. Introduction 

Let 7r = 7T17T2 • • • 7r„ be a permutation of length n. Let r = t\ ■ ■ ■ be another 
permutation. An occurrence of r in 7r is a subsequence ir,^ ■ ■ ■ ir,i k of ir that is order- 
isomorphic to r. For instance, 246 is an occurrence of r = 123 in it = 251436. 
We say that tt avoids r if tt contains no occurrence of r. For instance, the above 
permutation tt avoids 1234. The set of permutations of length n is denoted by S n , 
and <S n (r) denotes the set of r-avoiding permutations of length n. 

The idea of systematically studying pattern avoidance in permutations appeared 
in the mid-eighties JHI- The main problem in this field is to determine S n (r), the 
cardinality of S n (r), for any given pattern r. This question has subsequently been 
generalized and refined in various ways (see for instance Q]|U[Z|E3) anc ^ EH f° r 
a recent survey). However, relatively little is known about the original question. 
The case of patterns of length 4 is not yet completed, since the pattern 1324 still 
remains unsolved. See El EDI El for other patterns of length 4. 

For length 5 and beyond, all the solved cases follow from three important generic 
results. The first one, due to Gessel [HIE]) gives the generating function of the 
numbers S n (12 ■ ■ ■ k). The second one, due to Stankova and West [22], states that 
5„(231r) = 5„(312t) for any pattern r on {4, 5, ... , k}. The third one, due to Back- 
elin, West and Xin pj], shows that 5„(12 • ■ • kr) = S n (k ■ ■ ■ 21r) for any pattern r 
on the set {k + 1, k + 2, . . . ,£}. In the present paper an analogous result is estab- 
lished for pattern-avoiding involutions. We denote by X n (r) the set of involutions 
avoiding r, and by 7 n (r) its cardinality. 
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The systematic study of pattern avoiding involutions was also initiated in > 
continued in [H1E3] for increasing patterns, and then by Guibert in his thesis jllj , 
Guibert discovered experimentally that, for a surprisingly large number of pat- 
terns t of length 4, I n (r) is the nth Motzkin number: 



This was already known for r = 1234 (see [E|), and consequently for r = 4321, 
thanks to the properties of the Schensted correspondence jTH] ■ Guibert explained all 
the other instances of the Motzkin numbers, except for two of them: 2143 and 3214. 
However, he was able to describe a two-label generating tree for the class I„(2143). 
Several years later, the Motzkin result for the pattern 2143 was at last derived from 
this tree: first in a bijective way 52], then using generating functions [fj. No simple 
generating tree could be described for involutions avoiding 3214, and it was only in 
2003 that Jaggard gave a proof of this final conjecture, inspired by [2|. More 
generally, he proved that for k — 2 or 3, / n (12 ■ • ■ kr) = I n (k ■ ■ ■ 2 It) for all r. He 
conjectured that this holds for all k, which we prove here. 

We derive this from another result, which may be more interesting than its im- 
plication in terms of forbidden patterns. This result deals with a transformation 
4>* that was defined in p] to prove that S n (12 ■ ■ ■ kr) = S n (k ■ ■ ■ 21r). This trans- 
formation acts not only on permutations, but on more general objects called full 
rook placements on a Ferrers shape (see Section [3 for precise definitions). The map 
4>* may, at first sight, appear as an ad hoc construction, but we prove that it has 
a remarkable, and far from obvious, property: it commutes with the inversion of 
a permutation, and more generally with the corresponding diagonal reflection of a 
full rook placement. (By the inversion of a permutation ir we mean the map that 
sends n, seen as a bijection, to its inverse.) 

The map tfi* is defined by iterating a transformation <f>, which chooses a certain 
occurrence of the pattern k ■ ■ ■ 21 and replaces it by an occurrence of (k — 1) • • • 21k. 
The map cj> itself does not commute with the inversion of permutations, and our 
proof of the commutation theorem is actually quite complicated. 

This strongly suggests that we need a better description of the map <j)* , on which 
the commutation theorem would become obvious. By analogy, let us recall what 
happened for the Schensted correspondence: the fact that the inversion of permu- 
tations exchanges the two tableaux only became completely clear with Viennot's 
description of the correspondence [23| . 

Actually, since the Schensted correspondence has nice properties regarding the 
monotone subsequences of permutations, and provides one of the best proofs of the 
identity 7 ra (12 • • • k) = I n (k ■ ■ ■ 21), we suspect that the map 4>* might be related to 
this correspondence, or to an extension of it to rook placements. 



One of the main implications of this paper is the following. 

Theorem 1 . Let k > 1. Let T be a set of patterns, each starting with the prefix 
12 • • • k. Let T' be the set of patterns obtained by replacing this prefix by k ■ ■ ■ 21 in 
every pattern ofT. Then, for all n > 0, the number of involutions of S n that avoid 
T equals the number of involutions of S n that avoid T' . 

Ln particular, the involutions avoiding 12 • • ■ kr and the involutions avoiding 
k ■ ■ ■ 21r are equinumerous , for any permutation r of {k + 1, k + 2, . . . , £}. 
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Figure 1. A full rook placement on a Ferrers board, and its inverse. 



This theorem was proved by Jaggard for k = 2 and k = 3 It is the 

analogue, for involutions, of a result recently proved by Backelin, West and Xin for 
permutations P]. Thus it is not very suprising that we follow their approach. This 
approach requires looking at pattern avoidance for slightly more general objects 
than permutations, namely, full rook placements on a Ferrers board. 

Let A be an integer partition, which we represent as a Ferrers board (Figure QJ. 
A full rook placement on A, or a placement for short, is a distribution of dots on 
this board, such that every row and column contains exactly one dot. This implies 
that the board has as many rows as columns. 

Each cell of the board will be denoted by its coordinates: in the first placement 
of Figure^ there is a dot in the cell (1,4). If the placement has n dots, we associate 
with it a permutation tt of S n , defined by 7r(i) = j if there is a dot in the cell 
The permutation corresponding to the first placement of Figure^is 7f = 4312. This 
induces a bijection between placements on the n x n square and permutations of 

The inverse of a placement p on the board A is the placement p' obtained by 
reflecting p and A with respect to the main diagonal; it is thus a placement on the 
conjugate of A, usually denoted by A'. This terminology is of course an extension 
to placements of the classical terminology for permutations. 

Definition 2. Let p be a placement on the board A, and let it be the corresponding 
permutation. Let r be a permutation of Sk- We say that p contains r if there 
exists in 7r an occurrence tt^ 7T, 2 ■ • ■ iti k of r such that the corresponding dots are 
contained in a rectangular sub-board of A. In other words, the cell with coordinates 
(ifc,maxj 7rj.) must belong to A. 

The placement of Figure contains the pattern 12, but avoids the pattern 21, 
even though the associated permutation 7r = 4312 contains several occurrences 
of 21. We denote by S\{t) the set of placements on A that avoid r. If A is self- 
conjugate, we denote by I\(t) the set of symmetric (that is, self- inverse) placements 
on A that avoid r. We denote by S\(t) and I\(t) the cardinalities of these sets. 

In |2j E21 , it was shown that the notion of pattern avoidance in placements 
is well suited to deal with prefix exchanges in patterns. This was adapted by 
Jaggard ^1] to involutions: 

Proposition 3. Let a and (3 be two involutions ofSk- LetT a be a set of patterns, 
each beginning with a. Let Tp be obtained by replacing, in each pattern ofT a , the 
prefix a by /3. If, for every self-conjugate shape X, I\(a) — I\(/3), then I\(T a ) = 
I\(Tp) for every self-conjugate shape. 

Hence Theorem^will be proved if we can prove that I\(12 ■ ■ ■ k) = I\(k ■ ■ ■ 21) for 
any self-conjugate shape A. A simple induction on k, combined with Proposition 03 
shows that it is actually enough to prove the following: 



Theorem 4. Let X be a self-conjugate shape. Then I\(k ■ ■ ■ 21) = I\((k— 1) • ■ ■ 21fc). 
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A similar result was proved in jH] for general (asymmetric) placements: for every 
shape A, one has S\(k ■ ■ ■ 21) = S\((k — 1) • • • 21k). The proof relies on the descrip- 
tion of a recursive bijection between the sets S\(k ■ ■ ■ 21) and S\((k — 1) • • • 21fc). 
What we prove here is that this complicated bijection actually commutes with the 
inversion of a placement, and this implies Theorem 0J 

But let us first describe (and slightly generalize) the transformation defined by 
Backelin, West and Xin P]. This transformation depends on k, which from now on 
is supposed to be fixed. Since TheoremQ]is trivial for k = 1, we assume k > 2. 

Definition 5 (The transformation 4>). Let p be a placement containing k ■ ■ ■ 21, 
and let it be the associated permutation. To each occurrence of k ■ ■ • 21 in p, there 
corresponds a decreasing subsequence of length k in ir. The A-sequence of p, denoted 
by A(p), is the smallest of these subsequences for the lexicographic order. 

The corresponding dots in p form an occurrence of k ■ ■ ■ 21. Rearrange these dots 
cyclically so as to form an occurrence of (k — 1) • • • 21fe. The resulting placement is 
defined to be (f>(p). 

If p avoids k ■ ■ ■ 21, we simply define <p(p) := p. The transformation <f) is also 
called the A-shift. 



7 4 6 3 5 2 1 



7 3 6 2 5 14 



Figure 2. The A-shift on the permutation 7 4 6 3 5 2 1, when k = 4. 

An example is provided by Figure|2](the letters of the ^4-sequence are underlined, 
and the corresponding dots are black) . It is easy to see that the .A-shift decreases the 
inversion number of the permutation associated with the placement (details will be 
given in the proof of Corollarv lll|l . This implies that after finitely many iterations of 
4>, there will be no more decreasing subsequences of length k in the placement. We 
denote by (j>* the iterated transformation, that recursively transforms every pattern 
k ■ ■ ■ 21 into (k — 1) • • ■ 21k. For instance, with the permutation 7r = 7463521 
of Figure Eland k = 4, we find 

tt = 7463521 — >7362514 — >3261574 = 0*(tt). 

The main property of 4>* that was proved and used in pj] is the following: 

Theorem 6 (The BWX bijection). For every shape X, the transformation <fi* 
induces a bijection from S\{{k — 1) • ■ ■ 21fc) to S\{k ■ ■ ■ 21). 

The key to our paper is the following rather unexpected theorem. 

Theorem 7 (Global commutation). The transformation 4>* commutes with the 
inversion of a placement. 

For instance, with it as above, we have 

n- 1 = 7642531 — >7421536 — >4217536 = ^(tt" 1 ) 

and we observe that 



DECREASING SUBSEQUENCES AND WILF EQUIVALENCE 



5 



Note, however, that ^(tt^ 1 ) ^ (</>(tt)) l . Indeed, ^(tt^ 1 ) = 7421536 while 
(</>(7r)) -1 = 642753 1, so that the elementary transformation (j), that is, the 
.A-shift, does not commute with the inversion. 

Theorems U3 and together imply that <f>* induces a bijection from 
T\{{k — 1) • • • 21/c) to I\(k---21), for every self-conjugate shape A. This proves 
Theorem 31 and hence Theorem The rest of the paper is devoted to proving 
Theorem which we call the theorem of global commutation. By this, we mean 
that the inversion commutes with the global tranformation <j>* (but not with the 
elementary transformation (j>). 

Remarks 

1. At first sight, our definition of the „4-sequence (Definition , does not seem to 
coincide with the definition given in Let ak • • • a 2 a\ denote the .4-sequence of the 
placement p, with > • • • > a\. We identify this sequence with the corresponding 
set of dots in p. The dot au is the lowest dot that is the leftmost point in an 
occurrence of k ■ ■ ■ 21 in p. Then ak-i is the lowest dot such that a^ak-i is the 
beginning of an occurrence of k ■ ■ ■ 21 in p, and so on. 

However, in p], the dot at is chosen as above, but then each of the next dots 
a' k _ 1 , . . . , a[ is chosen to be as far left as possible, and not as low as possible. 
Let us prove that the two procedures give the same sequence of dots. Assume 
not, and let aj 7^ a'j be the first (leftmost) point where the two sequences differ. 
By definition, aj is lower than a'j, and to the right of it. But then the sequence 
dfc_i • ■ • aj+ia'jttj ■ ■ • a.2<2i is an occurrence of the pattern k---21 in p, which is 
smaller than afc • • ■ a 2 ai for the lexicographic order, a contradiction. 

The fact that the .4-sequence can be defined in two different ways will be used 
very often in the paper. 

2. At this stage, we have reduced the proof of Theoremn]to the proof of the global 
commutation theorem, Theorem [3 

3. From local commutation to global commutation 

In order to prove that <f>* commutes with the inversion of placements, it would 
naturally be tempting to prove that (j> itself commutes with the inversion. However, 
this is not the shown above. Given a placement p and its inverse p', we 

thus want to know how the placements <j>{jp) and <p(p')' differ. 

Definition 8. For any shape A and any placement p on A, we define ip(p) by 

4>{p) := 4>(P')'- 
Thus il){p) is also a placement on A. 

Note that ip m (p) — (0 m (p'))', so that the theorem of global commutation, The- 
orem can be restated as tp* = 0*. 

Combining the above definition of ip with Definition gives an alternative de- 
scription of ip. 

Lemma 9 (The transformation ^1). Letp be a placement containing k ■ ■ ■ 21. Let 
b\, &2j • • • ) bk be defined recursively as follows: For all j , bj is the leftmost dot such 
that bj ■ ■ ■ &2&1 ends an occurrence of k ■ ■ ■ 21 in p. We call 6fe • • ■ 62&1 the ^-sequence 
of p, and denote it by B(p). 

Rearrange the k dots of the B-sequence cyclically so as to form an occurrence of 
(k — 1) • • • 21fc: the resulting placement is ip(p). 

If p avoids k---21, then ip(p) = p. The transformation ip is also called the 
S-shift. 
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According to the first remark that concludes Section we can alternatively 
define bj, for j > 2, as the lowest dot such that bj • ■ ■ ends an occurrence of 
k ■ ■ • 21 in p. 

We have seen that, in general, cj> does not commute with the inversion. That is, 
4>{v) 7^ ip{p) m general. The above lemma tells us that (f>(p) = if>(p) if and only 
if the .A-sequence and the /3-sequence of p coincide. If they do not coincide, then 
we still have the following remarkable property, whose proof is deferred to the very 
end of the paper. 

Theorem 10 (Local commutation). Let p be a placement for which the A- and 
B-sequences do not coincide. Then (f>(j>) and if)(p) still contain the pattern k ■ ■ ■ 21, 
and 

4>{if>{p)) = M(p)). 

For instance, for the permutation of Figure and k = 4, we have the following 
commutative diagram, in which the underlined (resp. overlined) letters correspond 
to the ^-sequence (resp. ^-sequence): 

7463521 




7362514 4362571 




3 2 6 15 7 4 

A classical argument, which is sometimes stated in terms of locally confluent and 
globally confluent rewriting systems (see and references therein), will show that 
Theorem implies ip* — <fi* , and actually the more general following corollary. 

Corollary 11. Let p be a placement. Any iterated application of the transforma- 
tions 4> and ip yields ultimately the same placement, namely 4>*{p). Moreover, all 
the minimal sequences of transformations that yield 4>*{p) have the same length. 

Before we prove this corollary, let us illustrate it. We think of the set of permu- 
tations of length n as the set of vertices of an oriented graph, the edges of which are 
given by the maps (j) and ip. Figure 01 shows a connected component of this graph. 
The dotted edges represent <\> while the plain edges represent if). The dashed edges 




Figure 3. The action of <f> and ip on a part of Sg, for k = 4. 
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correspond to the cases where 4> and ip coincide. We see that all the paths that 
start at a given point converge to the same point. 

Proof. For any placement p, define the inversion number of p as the inversion num- 
ber of the associated permutation 77 (that is, the number of pairs such that 
i < j and 77,; > ttj). Assume p contains at least one occurrence of k ■ ■ ■ 21, and let 
i\ < ■ ■ ■ < ik be the positions (abscissae) of the elements of the .4-sequence of p. A 
careful examination of the inversions of p and 4>(p) shows that 

k-l 

inv(p) — mv(4>(p)) = k — 1 + 2 Card {i : i rn < i < i m +i and 77^ > 77^ > Ki m+1 }. 

m— 1 

In particular, inv(0(p)) < inv(p). By symmetry, together with the fact that 
inv(77 _1 ) = inv(7r), it follows that inv(?/>(p)) < inv(p) too. 

We encode the compositions of the maps <f> and tp by words on the alphabet 
{4>,ip}. For instance, if u is the word 4>4> 2 , then u{p) = 4>ip 2 (p)- Let us prove, by 
induction on inv(p), the following two statements: 

1. If u and v are two words such that u(p) and v(p) avoid k ■ ■ ■ 21, then u(p) = v(p). 

2. Moreover, if u and v are minimal for this property (that is, for any non-trivial 
factorization u = uqUi, the placement u\{p) still contains an occurrence of k ■ ■ -21 
— and similarly for v), then u and v have the same length. 

If the first property holds forp, then u(p) = v{p) = (f>*(p). If the second property 
holds, we denote by L(p) the length of any minimal word u such that u{p) avoids 
&---21. 

If 77 is the identity, then the two results are obvious. They remain obvious, with 
L{p) = 0, if p does not contain any occurrence of k ■ ■ ■ 21. 

Now assume p contains such an occurrence, and u(p) and v (p) avoid k ■ ■ ■ 21. By 
assumption, neither u nor v is the empty word. Let / (resp. g) be the rightmost 
letter of u (resp. v), that is, the first transformation that is applied to p in the 
evaluation of u{p) (resp. v{p)). Write u = u' f and v = v'g. 

If f{p) = g(p), let q be the placement f(p). Given that inv(<7) < inv(p), and that 
the placements u(p) = u'{q) and v(p) = v'(q) avoid k ■ ■ ■ 21, both statements follow 
by induction. 

If f{p) 7^ ff(.P)> we ma Y assume, without loss of generality, that f = 4> and g = ip. 
Let qi = 4>(j>), <?2 = an d q = ^{''Pip) = "0(0(p)) (Theorem llOjl . The induction 
hypothesis, applied to qi, gives u'{qi) = 4>*(ip(qi)) = 4>*{q), that is, u(p) — 4>*{q) 
(see the figure below). Similarly, v'(q2) = <t>*{q2) = 4**{q), that is, v(p) = 4>*{q). 
This proves the first statement. If u and v are minimal for p, then so are u' and 
v' for and g 2 respectively. By the first statement of Theorem El 9i and (ft still 
contain the pattern k ■ ■ ■ 21, so L(g) = £(gi) — 1 = £(92) — 1, and the words u' and 
v' have the same length. Consequently, u and u have the same length too. □ 



P 




u(p) v(p) 
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Note. We have reduced the proof of Theorem to the proof of the local commu- 
tation theorem, TheoremEU The last two sections of the paper are devoted to this 
proof, which turns out to be unexpectedly complicated. There is no question that 
one needs to find a more illuminating description of 4>* , or of <j) ° i>, which makes 
Theorems and EH clear. 

4. The local commutation for permutations 

In this section, we prove that the local commutation theorem holds for permuta- 
tions. It will be extended to placements in the next section. To begin with, let us 
study a big example, and use it to describe the contents and the structure of this 
section. This example is illustrated in Figure El 

Example. Let ir be the following permutation of length 21: 

7T = 17 21 20 16 19 18 13 15 11 14 12 8 10 9 7 4 2 6 5 3 1. 

1. Let k = 12. The ^4-sequence of n is 

A(ir) = 17 16/15 14 12 10 9 7/6 5 3 1, 

while its S-sequence is 

B{ir) = 21 20 19 18/15 14 12 10 9 7/4 2. 

Observe that the intersection of A(ir) and B(ir) (delimited by '/') consists of the 
letters 15 14 12 10 9 7, and that they are consecutive both in A(ir) and B(ir). 
Also, B contains more letters than A before this intersection, while A contains 
more letters than B after the intersection. We prove that this is always true in 
Section 14.11 below (Propositions EH and |22j) . 

2. Let us now apply the £>-shift to ir. One finds: 

V>(tt) = 17 20 19 16 18 15 13 14 11 12 10 8 9 7 4 2 21 6 5 3 1. 

The new ^-sequence is now A(tp(n)) = 17 16/15 13 11 10 8 7/6 5 3 1. Observe 
that all the letters of A(ir) that were before or after the intersection with B(ir) are 
still in the new „4-sequence, as well as the first letter of the intersection. We prove 
that this is always true in Section l4~2l (Propositions l28l and l29l) . In this example, 
the last letter of the intersection is still in the new ^-sequence, but this is not true 
in general. 

By symmetry with respect to the main diagonal, after the ^4-shift, the letters of 
B that were before or after the intersection are in the new £>-sequence, as well as 
the first letter of A following the intersection fCorollarv l30fl . This can be checked 
on our example: 

(j>(n) = 16 21 20 15 19 18 13 14 11 12 10 8 9 7 6 4 2 5 3 1 17, 

and the new S-sequence is £(</>(tt)) = 21 20 19 18/13 11 10 8 7 6 /4 2. 

3. Let ai = bj denote the first (leftmost) point in A(n) n B(ir), and let = b e be 
the last point in this intersection. We have seen that after the S-shift, the new A- 
sequence begins with Ofe • • ■ a< = 17 16 15, and ends with aa-i • • • ai = 6 5 3 1. The 
letters in the center of the new .4-sequence, that is, the letters replacing asj_i • • • a^, 
are Xi-\ ■ ■ ■ Xd = 13 11 10 8 7. Similarly, after the .4-shift, the new S-sequence 
begins with bk ■ • • = 21 20 19 18, and ends with ad-i&e-i • • • &i = 6 4 2. The 
central letters are again Xi-i ■ ■ ■ Xd = 13 11 10 8 7! (See Figure QJ. This is not a 
coincidence; we prove in Section ED that this always holds (Proposition OH} • 

4. We finally combine all these properties to describe explicitly how the maps 
4> o ip and ip o cj) act on a permutation n, and conclude that they yield the same 
permutation if the A- and S-sequences of n do not coincide (Theorem |H2j>- 




Figure 4. Top: A permutation tt, with its A- and S-sequences 
shown. Left: After the £>-shift. Right: After the ^4-shift. Bottom: 
After the composition of cf) and tp. 
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4.1. The .4-sequence and the £>-sequence 

Definition 12 (Labels). Let tt — ttitt2 • ■ • 7r„ be a permutation. For 1 < i < n, let 

£i be the maximal length of a decreasing subsequence in tt that starts at 7r,. The 
length sequence, or £-sequence, of tt is £{tt) — £\£2 ■ ■ -£ n - Alternatively, it can be 
defined recursively as follows: £ n = 1 and, for i < n, 

ii = max{4} + 1, (1) 

where the maximum is taken over all m > i such that ir m < iTi. 

We refer to the entries of the ^-sequence as labels and say that the label £i is 
associated to the letter TTi in tt. Also, if x = tti then, abusing notation, we let 

£{x) = h. 

Given a subsequence s = tt^tt^ ■•■7r, (t of tt, we say that £i 1 ,£i 2 , ...,£i k is the 
subsequence of £{tt) associated to s. 

Here is an example, where we have written the label of m below m for each i: 

tt = 374918562 
2 3 2 4 1 3 2 2 1 

The subsequence of £(ir) associated to 741 is 3, 2, 1. 

Lemma 13. The subsequence of £{tt) associated to a decreasing subsequence x m ■ ■ ■ X2X\ 
in tt is strictly decreasing. In particular, £{xi) > i for all i. 

Proof. Obvious, by definition of the labels. □ 

Lemma 14. Let x\, . . . ,X{ be, from left to right, the list of letters in it that have 
label m. Then x\ < X2 < ■ ■ ■ < 

Proof. If Xj > Xj+i then, since Xj precedes xj + i, we would have £(xj) > £(xj + i), 
contrary to assumption. □ 

Definition 15 (Successor sequence). Let a; be a letter in tt, with £(x) = m. The 
successor sequence s m s m _i ■ ■ ■ s\ of x is the sequence of letters of tt such that s m = x 
and, for i < m, Si-i is the first (leftmost) letter after Si such that £{si~i) = £{si) — l. 
In this case, we say that s rn _i is the label successor of x. 

Lemma 16. The successor sequence of x is a decreasing sequence. 

Proof. By definition of the labels, one of the letters labelled £{x) — 1 that are to 
the right of x is smaller than x. By Lemma PTH the leftmost of them, that is, the 
label successor of x, is smaller than x. □ 

Let us now rephrase, in terms of permutations, the definitions of the ^-sequence 
and £>-sequence (Definition and Lemma El . 

Given a permutation tt that contains a decreasing subsequence of length k, the 
^4-sequence of tt is the sequence A(tt) — auak-i ••■oi, where for all i, a, is the 
smallest letter in tt such that a/t • ■ • a^+iai is the prefix of a decreasing sequence of 
tt of length k. The £>-sequence of tt is B(tt) — bkbk-i ■ • ■ b\, where for all i, bi is the 
leftmost letter such that ■ • • b\ is the suffix of a decreasing sequence of length 

k. According to the remark at the end of Sectional the letter <2j can alternatively 
be chosen as left as possible (for i < k), and the letter bi as small as possible (for 
i > 1). 

The three simple lemmas above, as well as Lemma, ITTI below, will be used fre- 
quently, but without specific mention, in the remainder of this section. From now 
on we denote by A = a* ■ • • a\ and B = bk ■ • ■ bi the A- and S-sequences of tt. The 
next lemma characterizes the ^-sequence in terms of labels. 
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Lemma 17. The letter a k is the leftmost letter in it with label k and, for i < k, 
cii is the first letter after dj+i that has label i. In particular, the A-sequence of it 
is the successor sequence of a^, and the subsequence of £(ir) associated to A(ir) is 
k ■) k 1 ..... 1 . 

Proof. Clearly, the label of a k must be at least k. If it is larger than k, then the 
label successor of is smaller than a k and is the first letter of a decreasing sequence 
of length k, a contradiction. Hence the label of a k must be exactly k. Now given 
that <Zfc has to be as small as possible, Lemma E] implies that a k is the leftmost 
letter having label k. 

We then proceed by decreasing induction on i. Since ai is smaller than, and 
to the right of, aj+i, its label must be at most i. Since a k • ■ -ttj is the prefix of 
a decreasing sequence of length k, the label of ctj must be at least i, and hence, 
exactly i. Since we want dj to be as small as possible, it has to be the first letter 
after a,+i with label i (LemmaEl- □ 

Lemma 18 (The key lemma). Let i < j. Suppose ir contains a decreasing 
sequence of the form bj+iXj ■ ■ ■ Xi such that Xi precedes hi. Then £{xi) < £(bi). 

Proof. First, observe that, by definition of B, one actually has Xi < 6j (otherwise, 
the £>-sequence could be extended). Suppose that £(xi) > £(bi). In particular, 
then, £(xi) > i. Let us write £(xi) = i + r, with r > 0. Let XiXi-i ■ ■ -X- r +i be 
the successor sequence of Xi, so that £{x v ) = p + r for all p < i. Now, £(xi- m ) > 
£{bi- m ) for all m £ [0, i — 1], because the labels of the S-sequence are strictly 
decreasing. Thus, if Xi- m < bi- m then Xi- m must precede for otherwise 

£{bi—rn) £\Xi — nh)- 

Recall that x; < hi. Let m be the largest integer with m < i such that Xi- m < 
bi-m, which implies that Xi- m precedes bi_ m (clearly, m > 0). If m = i — 1 then 
Xi <bi, so x\ precedes b\, and thus the sequence 

b k ■ ■ ■ bj+xXjXj-i ■ ■ - xi 

is decreasing, has length k and ends to the left of b\ , which contradicts the definition 
of the S-sequence. Thus m < i — 1. Now, Xi— m < 6j_ TO and Xi- m precedes &i_ m , 
but Xi- m -i > bi-m-i- Note that Xi- m precedes 6i- TO _i since it precedes &i_ m . 
Thus, the sequence 

bk- - ■ bj+iXjXj-! ■ ■ ■ Xi_ m & 4 _ m _i • ■ • h 

is decreasing and has length k. Since Xi~ m precedes 6j_ m , the definition of B implies 
that Xi- m would have been chosen instead of &i_ m in B. This is a contradiction, 
so £{ Xi ) < £(bi). □ 

Lemma 19. Assume the label successor ofb m does not belong to B. Then no letter 
of the successor sequence of b m belongs to B, apart from b m itself. 

Proof. Let x be the label successor of b m , and let x r • ■ ■ x\ be the successor sequence 
of x, with x r = x. Assume one of the Xi belongs to B, and let x s -i = bj be the 
leftmost of these. The successor sequence of b m thus reads b 
By assumption, s < r. 

We want to prove that the sequence x r ■ ■ ■ x s is longer than £> m _i • • • &j+i, which 
will contradict the definition of the S-sequence of it. We have £{x r ) + 1 = £{b m ) > 
£(b m -i), so that £{x r ) > £(6 m _i). Hence by Lemma FT^l 6 m _i precedes x r . This 
implies that 

£{x r ) >t(b m - 1 ), 
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for otherwise the label successor of b m would be 6 m _i instead of x r . At the other 
end of the sequence x r ■ ■ ■ x s , we naturally have 

l{x s ) =l + £(b j )<£(b j+1 ). 

Given that the Xi form a successor sequence, while the labels of B are strictly de- 
creasing, the above two inequalities imply that x r ■ ■ ■ x s is longer than 6 m _i • • • bj +i , 
as desired. □ 

Lemma 20. Assume that ad = b e with e > 1, and that 6 e _i does not belong to 
A. Then d > 1 and 6 e _i precedes ad-i- Moreover, 6 e _i < ad-i and £{b e -i) < 
£{a d -i) = d-l. 

By symmetry, if a; = bj with i < k and a,i + \ does not belong to B, then j < k 
and a;+i precedes frj+i. Moreover, a.; + i < bj+\. 

Proof. If d — 1, then a k ■ • • a\ is a decreasing sequence of length k that ends to the 
left of b\ and this contradicts the definition of B. Hence d > 1. 

We have ad-\ < b e and £(ad-i) > £(& e -i)- By Lemma^l this implies that 6 e _i 
precedes a^-i- 

By the definition of .A, we have 6 e _i < cid-i, for otherwise 6 e _i could be inserted 
in A. 

Finally, if £(b e -i) = £(ad-i) then 6 e _i would be the next letter after ad in the 
.4-sequence, since 6 e _i precedes ad-i- □ 

Proposition 21. Ifb e G A and & e _i ^ ^4 then b m $ A for allm < e. Consequently, 
the intersection of A and B is a (contiguous) segment of each sequence. 

Proof. Suppose not, so there is an m < e — 1 with b m G A. Let d and p be such 
that ad = b e and a p = b m . By Lemma EOl £(6 e -i) < £(o-d-i), so there are more 
letters in the .4-sequence than in the 23-sequence between b e and b m . But then the 
sequence 

b k ■ ■ ■ b e a d -i ■ ■ • a p b m ^i ■ ■ ■ b 2 

has length at least k, which contradicts the definition of the 23-sequence. Hence the 
intersection of A and B is formed of consecutive letters of B. By symmetry, it also 
consists of consecutive letters of A. □ 

The preceding proposition will be used implicitly in the remainder of this section. 

Proposition 22. If A and B intersect but do not coincide, then the A-sequence 
contains more letters than the B-sequence after the intersection and the B-sequence 
contains more letters than the A-sequence before the intersection. In particular, 
if a\ belongs to B or b k belongs to A, then the A-sequence and the B-sequence 
coincide. 

Proof. Let b e = ad be the last letter of the intersection. The yl-sequence has 
exactly d — 1 letters after the intersection. Let us first prove that d > 2. Assume 
d = 1. Then by Lemma E01 e = 1. Let a, = 6j be the largest element of A fl B. 
By assumption, i < k. By Lemma 1201 aj+i precedes fej+i and is smaller. This 
contradicts the definition of B. Hence d > 1. 

If the S-sequence contains any letters after the intersection, then £(b e -i) < d— 1, 
according to Lemmal20l so the £>-sequence can contain at most d— 2 letters after the 
intersection. This proves the first statement. The second one follows by symmetry 
(or by subtraction). □ 



Lemma 23. Assume £{b k ) = k. Then the A-sequence and B-sequence coincide. 
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Proof. Assume the two sequences do not coincide. If they intersect, their last 
common point being b e = ad, then Proposition shows that the sequence 



is decreasing and has length > k. This implies that (-{bk) > k, a contradiction. 

Let us now assume that the two sequences do not intersect. By definition of 
the „4-sequence, ak < bk- If bk precedes then £(bk) > £{ak) = k, another 
contradiction. Thus ak precedes bk- Let us prove by decreasing induction on h 
that ah precedes bh for all h. If this is true for some h £ [2, k], then ah is in the 
^4-sequence, dh-i and bh-i lie to its right and have the same label. Since ah-i is 
chosen in the .4-sequence, it must be left of bh-i- By induction, we conclude that 
ai precedes 61, which contradicts the definition of the S-sequence. □ 

4.2. The .4-sequence after the £>-shift 

We still denote by .4. = a& • • • a\ and B = bk ■ • • &i the A- and ^-sequences of a 
permutation n. Recall that the /3-shift performs a cyclic shift of the elements of 
the S-sequence, and is denoted ip. We begin with a sequence of lemmas that tell 
us how the labels evolve during the S-shift. 

Lemma 24 (The order of *4). Assume A and B do not coincide. In ip(ir), the 
letters ak, ■ ■ ■ , a%, &i appear in this order. In particular, £(a.i) > i in iP(tt), and tjj(ir) 
contains the pattern k ■ ■ ■ 21. 

Proof. The statement is obvious if A and B do not intersect. Otherwise, let = bj 
be the first (leftmost) letter of A H B and let ad = b e be the last letter of A fl B. 
By Proposition |23 j < k. Hence when we do the S-shift, the letters a.i,...,ad 
move to the left, while the other letters of A do not move. Moreover, the letter ai 
will replace frj+i, which, by Lemma l20l is to the right of Oi+i. Hence the letters 
Ofc, . . . , 02) oi appear in this order after the 23-shift. □ 

Lemma 25. Let x < bk. Then the label of x cannot be larger in ipM than in tt. 

Proof. We proceed by induction on x G {1, . . . , bk}, and use the definition Q) (in 
Definition I12JI of the labels. The result is obvious for x = 1. Take now x > 2, and 
assume the labels of 1, . . . , x — 1 have not increased. If x £ B, all the letters that 
are smaller than x and to the right of x in tfj(n) were already to the right of x in 
tt, and have not had a label increase by the induction hypothesis. Thus the label 
of x cannot have increased. The same argument applies if x = bk. 

Assume now that x = b m , with m < k. Then b m has moved to the place of 
6 m +i during the S-shift. The letters that are smaller than b m and were already 
to the right of x in n have not had a label increase. Thus they cannot entail a 
label increase for b m . The letters that are smaller than b m and lie between b m+ \ 
and b m in 7r have label at most £(b m ) — 1 in tt ('Lemma ll8|l . and hence in i/j(tt), by 
the induction hypothesis. Thus they cannot entail a label increase for b m either. 
Consequently, the label of b m cannot change. □ 

Note that the label of letters larger than bk may increase, as shown by the 
following example, where k = 3: 



b k --- 



b e a d -i ■ ■ ■ ai 



= 37481562 
2 3 2 3 1 2 2 1 



■0(tt) 



= 34187562 
2214322 1. 



Lemma 26 (The labels of .4). Assume A and B do not coincide. The labels 
associated to the letters ak, ■ ■ ■ ,a\ do not change during the B -shift. 
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Proof. By Lemma l2~H the label of a 2 ; cannot decrease and by Lemma l2~Kl it cannot 
increase either. □ 

Lemma 27 (The labels of B). Let m < k. The label associated to b m does not 
change during the B-shift (although b rn moves left). 

Proof. By Lemma l2~51 the label of b rn cannot increase. Assume that it decreases, 
and that to is minimal for this property. Let x be the label successor of b m in tt. 
Then x is still to the right of b m in i/){tt), and this implies that its label has decreased 
too. By the choice of to, the letter x does not belong to B. Let x r ■ ■ ■ x\ be the 
successor sequence of x in tt, with x r = x. By LemmaEH none of the Xj are in B. 
Consequently, the order of the Xi is not changed during the shift, so the label of x 
cannot have decreased, a contradiction. Thus the label of b m cannot decrease. □ 

Proposition 28 (The prefix of .4). Assume A and B do not coincide. Assume 
afc , . . . , aj+i do not belong to B, with < i < k. The A-sequence of ip(ir) begins 
with afc • • ■ <2j-|_i and even with a^ - ■ -di if i> 0. 

Proof. We first show that a& is the first letter of A(iP(tt)). Suppose not. Let x be 
the first letter of the new ^4-sequence. Then x has label k in iP(tt) and is smaller 
than afc, since au still has label k in ip(ir), by Lemma |2J3 Since x was already 
smaller than in tt, it means that the label of x has changed during the K-shift 
(otherwise it would have been the starting point of the original yl-sequence) . By 
Lemma |221 the label of x has actually decreased. In other words, the label of x is 
larger than k in tt. 

But then the successor sequence of x in tt must contain a letter with label k, 
and this letter is smaller than x and hence smaller than at, which contradicts the 
choice of at ■ Thus the first letter of the new ,4-sequence is at ■ 

We now prove that no letter can be the first (leftmost) letter that replaces one 
of the letters afe_i,...,a, in the new A-sequence. Assume that the „4-sequence 
of f/ ; ( 7r ) starts with ■ ■ -a p+ \x, with i < p < k and x ^ a p . Then x has label 
p in iP(tt), an d CL p has label p as well fLemma l26JI . Since x is chosen in A(iP{tt)) 
instead of a p , this means that a/., . . . , a p +i, x, a p come in this order in i^(tt), and 
that x < a p . Let us prove that the letters a%, . . . , a p +i,x, a p also come in this order 
in tt. Since . . . , a p +\ do not belong to B 7 they cannot have moved during the 
shift, so it is clear that x follows a p+ \ in tt. Moreover, x must precede a p in tt, 
otherwise we would have p = £(a p ) > £(x) in tt, contradicting Lemma 1251 

Thus dfc, . . . , cip+i, x, a p come in this order in tt, and Lemma |23 implies that 
i(x) > p in tt. By definition of the ^l-sequence, £(x) cannot be equal to p. Hence 
£(x) > p, which forces £(a p+ i) > p + 1, a contradiction. 

Since no letter can be the first letter replacing one of a^-i, ■ ■ ■ , ctj+i, flj in the 
new .4-sequence, these letters form the prefix of the new .4-sequence. □ 

The example presented at the beginning of this section shows that the next letter 
of the .A-sequence, namely cij-i, may not belong to the A-sequence after the £>-shift. 

Proposition 29 (The suffix of A). Assume A andB intersect but do not coincide. 
Let ad- i be the first letter of A after AC\B . After the B-shift, the A-sequence ends 
with cid-i ■ ■ ■ a\. 

Proof. Observe that the existence of dd-i follows from Proposition l22l 

Most of the proof will be devoted to proving that ad-i still belongs to the A- 
sequence after the S-shift. Suppose not. Let a m = b p be the rightmost letter of 
A(~) B that still belongs to the ^4-sequence after the S-shift (such a letter does 
exist, by Proposition 1281 . Let ad = b e be the rightmost letter of AOB. (Note that 
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d — e = m — p.) The .A-sequence of ends with a m x m -i ■ ■ ■ XdXd-iUd-2 • • • Ui, 
with £(xj) = j, and Xj 7^ aj for to — 1 > j > d — 1. Let us prove that none of 
the Xj were in the original ^-sequence. If Xj were in the original £>-sequence, its 
label in tt would have been j (Lemma EE - But for m — 1 > j > d, the only letter 
of B(n) having label j is aj, and by LemmaEOl no letter in B(ir) has label d — 1. 
Thus the Xj cannot have been in 6(71-). This guarantees that they have not moved 
during the S-shift. Moreover, since they are smaller than bk, their labels cannot 
have increased during the shift fLemma l2ol) , 

Let us prove that for m — 1 > ft > d — 1, the letter Xh precedes at in We 
proceed by decreasing induction on ft. First, a m belongs to A(ip(ir)) by assumption, 
the letters x m -\ and a m _i are to its right and have the same label, and x m -\ is 
chosen in the .A-sequence of ip(ir), which implies that it precedes a rn -\. Now assume 
that Xh precedes ah in VK 71 "); with to — 1 > ft > d. The letter Xh belongs to A^i^)), 
the letters Xh-i and a^-i are on its right and have the same label, and Xh-i is 
chosen in the new ^-sequence, which implies that it precedes ah-i- Finally, Xd-i 
precedes a^-i in ip(ir), and is smaller than it. 

Let us focus on Xd-i- Assume first that it is to the right of ad in tt. Since 
£(xd-i) > d — 1 in 7r, there is a letter y in the successor sequence of Xd-i that has 
label d — 1 and is smaller than ct<z-i) which contradicts the choice of ad-i in the 
original *4-sequence. 

Thus Xd-i is to the left of a<j in tt, and hence to the left of b e -\. The sequence 
bp+ix m -i ■ ■ ■ Xd-i is a decreasing sequence of it of the same length as b p+ ib p ■ ■ ■ b e , 
and Xd-i precedes 6 e _i. By Lemma^J this implies that £(xd-i) < t{b e -\). But 
£(xd-i) > d — 1, so that £{b e -\) > d = £{b e ), which is impossible. 

We have established that ad-i belongs to the .4-sequence after the K-shift. As- 
sume now that cid-i, o.d-2, ■■ ■ ,o-h ah belong to the new .4-sequence, but not a/j_i, 
which is replaced by a letter Xh-i- This implies that Xh-i < ah-i- By Lemma l25l 
the label of Xh-i was at least h — 1 in tt. Also, Xh-i was to the right of ah in ir. 
Thus in the successor sequence of Xh-i in ir, there was a letter y, at most equal to 
Xh-i, that had label ft — 1 and was smaller than ah-i, which contradicts the choice 
of ah-i in the original „4-sequence. □ 

4.3. The composition of cf> and ip 

We have seen that the beginning and the end of the ^4-sequence are preserved 
after the £>-shift. By symmetry, we obtain a similar result for the K-sequence after 
the Ashift. 

Corollary 30. Assume A and B intersect but do not coincide. Let a,i = bj be the 
leftmost element of AC\B and let ad = b e be the rightmost element of Af)B. After 
the A-shift, the B-sequence begins with bk ■ ■ ■ 6j+i and ends with ad-\b e -\ ■ ■ ■ b\. 

Proof. This follows from Propositionsl28land l291 together with symmetry. Namely, 
since by Proposition |2H1 the first (largest) letter of the intersection still belongs 
to the *A-sequence after the S-shift, the place of the last (smallest) letter of the 
intersection still belongs to the S-sequence after the .4-shift. After the ^4-shift, the 
letter in this place is cid-i- The rest of the claim follows directly from symmetry, 
together with the propositions mentioned. □ 

It remains to describe how the intersection of the A- and £>-sequences is affected 
by the two respective shifts. 

Proposition 31 (The intersection of A and B). Assume A and B intersect but 
do not coincide. Let a{ = bj be the leftmost element of An B and let ad = b e be 
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the rightmost element of AC\B. Let ■ ■ ■ aiXi-\ • • • Xdad-i ■ ■ ■ a\ be the A-sequence 
of Let bk ■ ■ ■ frj+iyj-i ■ ■ ■ ydQd-\b e -\ ■ ■ - b\ be the B-sequence of 4>{it). Then 

x m = Vm for all m. Moreover, x m lies at the same position in iP(tt) and 4>(ir). 

Proof. First, note that the above form of the two sequences follows from Proposi- 
tions EHl EH and Corollary E01 Note also that if i = d, that is, the intersection is 
reduced to a single point, then there is nothing to prove. 

Our first objective is to prove that the sequences X = cc,_i • • • Xd and y = 
Vi-i ■ ■ ■ Vd are the A- and S-sequences of length i — d of the same word (the gen- 
eralization of the notion of A- and S-sequences to words with distinct letters is 
straightforward) . 

By definition of the A-sequence of i/>(tt), X is the smallest sequence of length 
i — d (for the lexicographic order) that lies between a, and ad-i in iP(tt). By this, 
we mean that it lies between 04 and a^-i both in position and in value. 

Let p m denote the position of b m in n. Let us show that X actually lies between 
the positions Pj+i and p e (Figure EJ. The first statement is clear, since Pj+\ is 
the position of a* in In order to prove that Xd is to the left of p e in VK 71 "); 

we proceed as at the beginning of the proof of Proposition [23 We may assume 
Xd 7^ o,d (otherwise, Xd is definitely to the left of p e ). Let a m be the rightmost 
letter of A (~l B that belongs to the A-sequence after the £>-shift (such a letter does 
exist, and d < m <i). The A-sequence of ip(ir) ends with a m x m -i ■ ■ -XdCid-i ■ ••oi, 
with £(xj) = j for all j, and Xj ^ aj for m — 1 > j > d. 

Let us prove, by a decreasing induction on j £ [d, m — 1], that the letter xj 
precedes a,j for all j. First, a m belongs to A^M) by assumption, the letters x m -i 
and a m -i are to its right and have the same label, and x m _i is chosen in the new 
^4-sequence, which implies that it precedes a m -i- Now assume that Xh precedes au 
in ip(ir), with m — 1 > h > d. The letter Xh belongs to A(ip(ir)), the letters Xh-% 
and ah-i are on its right and have the same label, and Xh-i is chosen in the new 
.A-sequence, which implies that Xh-i precedes a^-i, and concludes our proof that 
Xj precedes dj. In particular, Xd is to the left of ad, and hence to the left of the 
position p e . 

We can summarize the first part of this proof by saying that X is the smallest 
sequence of length i — d in V ; ( 7r ) that lies in position between Pj+i and p e and in 
value between a, and cid~i- In other words, let u be the word obtained by retaining 
in if)(ir) only the letters that lie between Pj+i and p e in position and between a* 
and dd-i in value. Then X is the A-sequence of length i — d of u. 

By symmetry, y is the ^-sequence of length i — d of the word v obtained by 
retaining in c))(tt) the letters that lie between Pj+i and p e in position and between 
di and ad-i in value. But the words u and v actually coincide, for they contain 

- the letters of ir that do not belong to A or B and lie between Pj+i and p e 
in position and between and cid-i in value. These letters keep in iP(tt) 
and c/>(ir) the position they had in ir, 

- the letters bj-i, . . . , b e , placed at positions pj, . . . ,p e +i (see FigureHJ. 

Observe also that u does not contain any decreasing sequence of length larger 
than i — d, because otherwise, we could use this sequence to extend the A-sequence 
of 4>( 7r )- Hence we have a word u with distinct letters, with its A- and S-sequences 
(of length i — d) and we know that there is no longer decreasing sequence in u. 
In particular, the rightmost letter of its S-sequence, has label i — d, and 

Lemma EHl implies that X and y coincide. □ 
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Figure 5. The A- and S-sequences in ir (top), and what happens 
to them after the 23-shift (left) and the ^4-shift (right). Only the 
black discs and squares belong to the permutations. The squares 
show some letters of the new .4-sequence (left) or new £>-sequence 
(right). The interior of the shaded rectangle contains the letters 
of u. 

Theorem 32 (Local commutation for permutations). Letn be a permutation 
for which the A- and B-sequences do not coincide. Then 4>(ir) and ip(ir) still contain 
the pattern k ■ ■ ■ 21, and 4>{ip{'K)) = ip(4>(ir)). 

Proof. The first statement follows from Lemma EH plus symmetry. 

Assume first that A and B are disjoint. By Proposition |2H1 the „4-sequence is 
unchanged after the Z?-shift. Thus the permutation cj)(ip{-K)) can be obtained by 
shifting A and B in it in parallel. By symmetry, this is also the result of applying 

if) O (j) to 77. 

Let us now assume that A and B intersect. Following the notation of Proposi- 
tion El let dfc • ■ • QiXi-i ■ ■ ■ XdO-d-i ■ ■ ■ di be the yl-sequence of ^(tt), and let 
bk ■ ■ ■ bj+iXi-i ■ ■ ■ XdCid-ib e -i ■ ■ ■ b\ be the S-sequence of </>(7r). Clearly, the only 
letters that can move when we apply 4> o ip (or ip o <f>) to 77, are those of A, B and 
X. We need to describe at which place each of them ends. We denote by p{x) the 
position of the letter a; in 77 (note that p{x) = 7r _1 (x)). 

Let us begin with the transformation (froip. That is, the S-shift is applied first. 
It is easy to see what happens to the letters that lie far away from the intersection 
of A and B (FigureHJ. During the S-shift, the letter bk is sent to pib\) and then it 
does not move during the .4-shift (it is too big to belong to the new .4-sequence) . 
Similarly, for j + 1 < h < k, and for 1 < h < e, the letter bh is sent to p(bh+i), and 



18 



MIREILLE BOUSQUET-MELOU AND EINAR STEINGRlMSSON 



then does not move. As far as the ^-sequence is concerned, we see that ah does 
not move during the S-shift, for 1 < h < d— 1 and i + 1 < h < k. Then, during the 
,4-shift, afc is sent to p{a\), and the letter ah moves to p(ah+i) for 1 < h < d — 1 
and i + 1 < h < k. 

It remains to describe what happens to a^-i, . . . , a.j, and to the Xh- The letter 
di moves to p(bj+i) first, and then, being an element of the new .4-sequence, it 
moves to p(ai+i). The letter cid-i only moves during the ^4-shift, and it moves to 
the position of Xd in ip{ir). For d < h < i — 1, the letter Xh moves to the position 
of Xh+i in VK 71 ")- The letter Xi_i moves to the position of ai in ip(ir), that is, to 
p(bj + i). Finally, the letters ah, with d < h < i, which are not in X move only 
during the £>-shift and end up at p(ah+i). 

Let us put together our results: When we apply <j>oip, 

- Xi-i moves to p(bj + i), 

- Xh moves to the position of Xh+i in for d < h < i — 1, 

- afc is sent to p{a\) and bk to p{b\), 

- ad-i moves to the position of Xd in iP(tt), 

- the remaining ah and bh move respectively to p{ah+\) and p(bh+i)- 

Now a similar examination, together with the fact that each Xh lies in the same 
position in iP(tt) and 4>(tt) (Pronosition l31|l . shows that applying ipocf) results exactly 
in the same moves. 

□ 

5. Local commutation: from permutations to rook placements 

The aim of this section is to derive the local commutation for placements (Theo- 
rem El from the commutation theorem for permutations ( Theorem I32J1 . We begin 
with a few simple definitions and lemmas. 

A corner cell c of a Ferrers shape A is a cell such that A\{c} is still a Ferrers shape. 
If p is a placement on A containing fc • ■ ■ 21, with .4-sequence Ofc ■ • ■ a\, then the A- 
rectangle of p, denoted by Ra, is the largest rectangle of A whose top row contains 
afe. Symmetrically, the B -rectangle of p, denoted by Rb, is the largest rectangle of 
A whose rightmost column contains &i (where bk ■ ■ ■ &i is the S-sequence of p) . By 
definition of the A- and S-sequences, i?g is at least as high, and at most as wide, 
as Rj,. See the leftmost placement of Figure El for an example. 

In the following lemmas, p is supposed to be a placement on the board A, con- 
taining the pattern k ■ ■ ■ 21. 

Lemma 33. Let c be a corner cell of A that does not contain a dot and is not 
contained in Ra- Let q be the placement obtained by deleting c from p. Then the 
A-sequences of p and q are the same. 

Proof. After the deletion of c, the sequence a^ ■ ■ ■ a\ remains an occurrence of 
k ■ ■ ■ 21 in q. Since the deletion of a cell cannot create new occurrences of this 
pattern, • • • ai remains the smallest occurrence for the lexicographic order. □ 

Lemma 34. Adding an empty corner cell c to a row located above R_a does not 
change the A-sequence. By symmetry, adding an empty corner cell to a column 
located to the right of R& does not change the B-sequence. 

Proof. Assume the ^-sequence changes, and let A' = a' k ■ ■ ■ a[ be the ^l-sequence 
of the new placement q. Observe that ■ ■ ■ ai is still an occurrence of k ■ ■ ■ 21 
in q. By the previous lemma, c belongs to R^> , the .4-rectangle of q. However, by 
assumption, c is above Ra- This implies that the top row of R_aj is higher than the 
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top row of Ra, so that a' k is higher (that is, larger) than a%. This contradicts the 
definition of the .A-sequence of q. □ 

Remark. The lemma is not true if the new cell is not added above Ra, as shown 
by the following example, where k = 2. The *4-sequence is shown with black disks. 



Let R be the smallest rectangle containing both Ra and It is possible that 
R is not contained in A. Let p R be the placement obtained by adding the cells of 
R \ A to p. The previous lemma implies the following corollary, illustrated by the 
central placement of Figure El 



Corollary 35. 

B-sequence. 



The placements p and p R have the same A-sequence and the same 



Proof. All the new cells are above Ra and to the right of Rb- 



□ 



In what follows, the definitions of the A- and £>-sequences, and of the maps ip 
and <p, are extended in a straightforward manner to partial rook placements (some 
rows and columns may contain no dot). We extend them similarly to words with 
distinct letters. 

Lemma 36. Let p be a partial rook placement containing the pattern k- ■ -21. // 
we delete a row located above a^, the A-sequence will not change. A symmetric 
statement holds for the deletion of a column located to the right of b\ . 

Proof. The sequence ajt ■ • • a\ is still an occurrence of k ■ ■ ■ 21 in the new placement, 
and deleting a row cannot create a new occurrence of this pattern. □ 




Figure 6. Left: A placement p, its A- and S-sequences (for k = 
3), and the rectangles R_a and Center: The placement p R . 
Right: The placement pa and the corresponding subsequence of ir. 



Proposition 37. Let it be the permutation associated with a placement p containing 
k---21. There exists a subsequence of ir that has the same A- and B-sequences 
as p. One such subsequence is 7Tr, the subsequence of ir corresponding to the dots 
contained in R. 

Proof. By Corollary ESI we can assume that R is included in A. By Lemma l3l)l wc 
can assume that A = R, which concludes the proof. □ 
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We shall denote by pn the (partial) placement obtained from p R by deleting all 
rows above R and all columns to the right of R (third placement in Figure EJ. 

Lemma 38. Let i < j < k. In ip(p), the maximum length of a decreasing sequence 
starting at bj and ending at bi isj—i+1, One such sequence is of course bjbj-i ■■ - bi. 

Proof. Clearly, it suffices to prove the statement under the assumption that bj and 
bi are the only letters in the sequence that are shifted elements of the 6-sequence 
of p, which we now assume. 

Suppose that there exists in tp(p) a longer decreasing sequence, of the form 
bjXjXj-i ■ ■ ■ Xi+ibi, where the x's do not belong to the S-sequence of p. Then 
bk ■ ■ ■ bj+iXj ■ ■ ■ Xi + \bi ■ ■ ■ b\ is an occurrence of the pattern k ■ ■ ■ 21 in p. The fact 
that Xi+i comes before bi in ip(p) means that Xi+\ precedes bi + i in p. This contra- 
dicts the construction of the S-sequence of p (Lemma [jjj. □ 

The following proposition is the last technical difficulty we meet in the proof of 
the commutation theorem. 

Proposition 39. Assume the A- and B-sequences of p do not coincide. Then tp(p) 
contains the pattern k ■ ■ ■ 21, and its A-sequence begins with ak- 

Proof. Let Rj\_ and i?g denote the A- and 23-rectangles of p. They form sub-boards 
of A. Let R be the smallest rectangle containing Ra and 

Let us first prove that there exists in ip(p) an occurrence of k ■ ■ ■ 21 starting 
with a/j. First, since p and pu have the same K-sequence (Proposition EZJ), the map 
ip acts in the same way on these two placements. This means that ip{PR) can be 
obtained from tjj{p) by deleting the rows above R& and to the right of Ra, and by 
adding the cells of R \ A. Then, by Proposition |2H1 *P(pr) contains an occurrence 
of k ■ ■ ■ 21 starting with at, namely, the .4-sequence of iP(pr). These dots are all 
contained in Ra, and so they form, in ip(p) also, an occurrence of k ■ ■ ■ 21 starting 
with afc. 

Now let Xk • • -x\ be the ^4-sequence of ij(p), and assume that Xk ^ ak (which 
implies that Xk < ak). We will derive from this assumption a contradiction, which 
will complete the proof. 

If none of the values Xj were in B(p), then they would form an occurrence of 
k---21 in p, which would be smaller than Ofe-'-ai, a contradiction. Hence at 
least one of the Xj is in B{p). Let xi = b m (resp. Xi+i — bj) be the leftmost 
(resp. rightmost) of these. Then Xk, ■ ■ ■ , X£ + i and Xi, . . . ,xi are in the same places 
in p as in ip(j>). 

We consider two cases: 

Case 1: Suppose first that one of the x r , for 1 < r < i, lies "above" the B- 
sequence in p. By this we mean that there exists an s such that b s < x r and b s 
precedes x r in p. Let r < i be maximal such that x r satisfies this condition. Let 
s be maximal such that b s satisfies this condition for x r . Clearly, s < k, because 
b s < x r < Xk < a k < b k . 

The maximality of s implies that 6 s+ i > x r . In fact, 6 s+ i is the smallest element 
of B that is larger than x r . Consider, in p, the decreasing sequence 

Xk--- x e+ ib m ■ ■ ■ b s+ ix r ■ ■ - xi. 

It is an occurrence of a decreasing pattern, which, given that Xk < ak, cannot be 
as long as Ofe • • ■ ai. That is, 

k- l + m- s + r <k. (2) 

Assume for the moment that r < i. By maximality of r, we know that x r+ i 
precedes b s in p. Let us show that it actually precedes 6 s +i (and thus precedes b s 
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in ip(p)). If not, x r +i lies between 6 s +i and b s . But x r +\ > b s , since x r > b s , and 
x r+ i < b s+ i by maximality of r. Thus x r +\ lies between 6 s +i and b s in position 
and in value, which contradicts the definition of the £>-sequence of p. Hence x r +i 
precedes b s +i, so the sequence xg - ■ ■ x r+ \b s in ip{p) is decreasing and has I — r + 1 
elements. But this sequence has xg = b m and b s as its endpoints, so, by Lemmal38l 
it has at most m — s + 1 points. In other words, £ — r + l < m—s+1, or i — r < m—s, 
contradicting J2J. 

Now if r = i, we have s < j (since b s < Xi and bj > Xi). The sequence xg ■ ■ ■ Xj+i 
in ijj{p) is decreasing and has I — i elements. But this sequence has as xg = b m and 
bj as its endpoints, so, by Lemma l38l it has at most m — j + 1 points. In other 
words, I — i < m — j + 1. But, since s < j, this contradicts (0. 

Case 2: We now assume that for each x r among Xi, . . . ,xi there is no s such that 
b s < x r and b s precedes x r in p. 

Lemma 1381 applied to the subsequence b m = xg , xg_i, . . . , Xi+\ = bj of ip(p), 
implies that £ — i < m — j + 1. That is, i — j > I — m — 1. Now, 

b k ■ --bj+iXi ■■■xi 

is a decreasing sequence in p of length k — j + i>k+£ — m — 1. At most fc — 1 
of its elements can precede b\, for else b\ could not be the rightmost letter of B(p). 
Hence, since b\ itself does not occur in this sequence, at least i — m of its elements 
must be preceded by b\, that is, xg- m , . . . , x\ all lie to the right of b\. Recall that 
none of the letters Xi,...,Xi are to the right of and above any b s , so xg- m , . . . , x\ 
must be smaller than b\ . But then 

X k ■ ■ ■ Xg + ib m ■ ■ ■ biXg- m ■ ■ ■ Xi 

is an occurrence of the pattern k ■ ■ ■ 21 in p, with x k < a k , which contradicts the 
definition of the „4-sequence. □ 

We are finally ready for a proof of the local commutation theorem, which we restate. 

Theorem (same as Theorem I10j> . Let p be a placement for which the A- and 
B-sequences do not coincide. Then 4>{p) and ip(p) still contain the pattern k ■ ■ ■ 21, 
and 

4>(i>{p)) - 

Proof. As above, let R be the smallest rectangle containing i?^ and Rs- The first 
statement follows from Proposition 0H3 and symmetry. 

We want to prove that the map <f> o tp acts in the same way on the placements 
p, p R and pa- If we prove this, then, by symmetry, the same holds for the map 
tp o (j). But the commutation theorem for permutations (Theorem I.V21) states that 
4>{ip(j>B,)) = 4'(4>{pr))- Thus 4>(ijj(p)) = ip((f>(p)), and we will be done. 

By CorollaryE3and Proposition E3 the placements p, p R and pr have the same 
S-sequence. Consequently, ip acts in the same way on these three placements. In 
other words, 

- ip(p R ) is obtained by adding to ip(p) the cells of R \ A; we summarize this 
by writing ip(p R ) = 4'(p) F! \ 

- *P(pr) is obtained by deleting from ip(p R ) the rows above R and the columns 
to the right of R. 

It only remains to prove that ip{p), tp(p R ) and tpipn) have the same ,4-sequence. 

By PropositionEHl the ^4-sequence of 2p(p) starts with a k - This means that the A- 
rectangle of tp(p) coincides with the A- rectangle of p. Hence Lemma 02] applied to 
tjj(p), implies that ip(p) an d i>{p) R have the same ^4-sequence. But ip(p) R = i})(p R ), 
so that ip(p) and ij}{p R ) have the same .4-sequence. The ^-sequence of 4>(p R ), being 
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contained in the .4- rectangle of p, is contained in R. By Lemma lH?)! the „4-sequences 
of iP(pr) and 4>{p R ) coincide. □ 
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